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DIGITAL IMAGE MAGNIFICATION FOR INTERNET APPLIANCE 

Killian D. Murphy 

FIELD OF THE INVENTION 

[0001] This invention relates to graphical user 

interfaces. More particularly, the present invention relates 
to a method for dynamically magnifying a moveable selected 
region of a digital image within a graphical user interface. 

BACKGROUND OF THE INVENTION 

[0002] When viewing images displayed on a television 

screen by an Internet appliance, it is often desirable to 
view a portion of that image in a magnified format in order 
to discern small details that are lost by the typically poor 
resolution found on television screens. For example, Chinese 
characters often include small details such as lines 
separated by small distances that are impossible to discern 
at typical television screen resolution. To discern which 
character is displayed, the character must be magnified 
enough to discern these small details. 
[0003] Figure 1 depicts a first conventional 

magnification tool disclosed in U.S. Patent No. 5,754,348 
(Soohoo) . Soohoo discloses a method for context -preserving 
magnification of selected digital image regions that allows 
simultaneous viewing of the magnified image and its 
unmagnified context (e.g., the unmagnified image surrounding 
the magnified image) . The method provides a floating window 
122 containing the magnified image that is superimposed on 
the original (unmagnified) background image. Floating window 
122 is moved around the display screen using an input device 
(e.g., a mouse or trackball), and displays a magnified image 
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of a selected region located under floating window 122 such 
that the magnified image within floating window 122 is 
superimposed over the selected region. 

[0004] A problem with the magnification tool taught by 

Soohoo is that Soohoo fails to display a cursor or other 
pointing device in floating window 122, and fails to teach or 
suggest a method for selecting (clicking on) interface 
elements, e.g. a hyperlink, located in floating window 122. 
It would be desirable to have a method for using the pointing 
device interactively with interface elements shown in 
floating window 122. Additionally, reading horizontal text 
is difficult when the width of floating window 122 is less 
than the display screen width. It would be preferable to 
have a window extending the width of the display screen to 
maximize the horizontal area, thereby maximizing the 
readability of text appearing in the floating window. 
[0005] Figure 2 depicts another conventional 

magnification tool provided in Windows 2 000 by Microsoft™ 
Corporation. A user interface 200 is divided into an upper 
portion 210 and a lower portion 220. Lower portion 220 
displays an original (unmagnif ied) background image along 
with a cursor 230. Selected region 255 borders a portion of 
the original background image and is centered on cursor 23 0. 
Upper portion 210 displays a magnified version of a selected 
region 22 5 of the original background image surrounding 
cursor 230. Upper portion 210 additionally displays a 
magnified version (cursor 230E) of cursor 230, which is 
proportionally located with respect to the magnified version 
of selected region 225 displayed in upper portion 210. 
[0006] A problem with the magnification tool shown in 

Figure 2 is that although this magnification tool provides a 
magnified format for viewing small details of the original 
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background image, it has the disadvantage that the context of 
the magnified image presented to the viewer is lost. 
Further, while a split screen display is suitable for high 
resolution computer monitors, the area occupied by such a 
split screen considerably reduces the available area on a 
television display, thereby making this magnification poorly 
suited for Internet appliances. 

[0007] What is needed is a magnification tool that 

facilitates the interaction with interface elements, such as 
push buttons, text entry boxes, and hyperlinks, while 
minimizing the amount of required screen space and 
maintaining context, thereby optimizing the magnification 
tool for Internet appliances. 

SUMMARY OF THE INVENTION 

[0008] The present invention is directed to a 

magnification tool optimized for an Internet appliance in 

that it magnifies a selected region of an original background 

image, and inserts the magnified image between the original 

background image and a cursor such that the (unmagnif ied) 

cursor is displayed on the magnified image. The display area 

taken up by the magnified image is smaller than that of the 

original background image, thereby enabling the original 

background image to show around the top and/or bottom of the 

magnified image which maintains context between the magnified 

image and the original background image as the cursor is 

moved about the display screen. As the cursor is moved, the 

magnified image is changed such that a point located on the 

magnified image below the cursor matches a corresponding 

point located on the original background image (i.e., the 

cursor is co-located relative to corresponding points on both 

the normal -sized selected region of the original background 
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image and the magnified image) . Accordingly, when a user 
locates the cursor over an interface element, e.g. a 
magnified hyperlink, displayed in the magnified image, the 
cursor is also located over the same interface element in the 
original background image (which is covered by the magnified 
image) , thereby facilitating convenient identification and 
selection of closely spaced or hard to read interface 
elements. An interface element is a portion of the graphical 
user interface (GUI) with which a user can interact. This 
magnified image is displayed as an overlay surface. An 
overlay surface is a picture that is not part of the original 
background image that is displayed on the display screen. 
The overlay surface, while being visible on the display 
screen, does not change the operation of a GUI with respect 
to the cursor and the original background image is not 
changed. As a result, the interface elements of the original 
background image under the cursor continue to respond to 
mouse clicks. In other words, the user appears to be mousing 
over and interacting with a magnified image because of the 
overlay of the magnified image in front of the original 
background image but behind the cursor. However, in reality, 
the mouse clicks are activating the interface elements in the 
original background image. Thus, the magnification tool of 
the present invention can be easily incorporated into the GUI 
with minimal disruption because the magnification tool simply 
inserts the magnified image between the cursor and the 
original background image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] These and other features, aspects and advantages 

of the present invention will become better understood with 
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regard to the following description, appended claims, and 
accompanying drawings, where: 

[0010] Figure 1 is simplified screen display showing a 

first conventional magnification tool; 

[0011] Figure 2 is a simplified screen display showing 

another conventional magnification tool; 

[0012] Figure 3 is a simplified screen display showing a 

magnification tool according to an embodiment of the present 
invention; 

[0013] Figure 4 is an exploded diagram showing successive 

layers of images (screens) that are superimposed to form the 
magnification screen display tool shown in Figure 3; 
[0014] Figure 5 is a simplified screen display showing 

the position of the magnified image relative to the cursor in 
the magnification tool according to a specific embodiment of 
the present invention; and 

[0015] Figures 6 (A) -6(D) are simplified screen display 

showing relative positioning between the magnified and 
original background images as the cursor is moved. 

DETAILED DESCRIPTION OF THE DRAWINGS 

[0016] Figure 3 is a simplified screen display showing a 

magnifying tool for magnifying a portion of an image shown on 
a display 300. Shown on display 300 are an original 
(unmagnif ied) background image 310, which is generated from 
image data stored in the display buffer of a video memory in 
an Internet appliance (not shown) , a magnified image 32 0, 
which is generated in accordance with the present invention 
and also stored in another portion of the video memory, and a 
cursor 330 that is position according to cursor position data 
also stored in the video memory. The Internet appliance can 
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be a VIA250 produced by ViaClix, Inc. of Campbell, 
California. 

[0017] As described in additional detail below, original 

background image 310, magnified image 320, and cursor 330 are 
superimposed over each other to form a composite image shown 
on display 300 according to known techniques. Original 
background image 310 includes "normal" (i.e., unmagnified) 
text 325 (or other indicia or graphics) , which in the present 
example includes the text "LINK 1" , "LINK 2", "LINK 3", and 
"LINK 4". Note that text "LINK 3" and "LINK 4" are masked by 
a portion of magnified image 320, which is indicated by 
shadow block type. In this embodiment, text "LINK 3" and 
"LINK 4" are not visible through magnified image 320 and are 
therefore shown in shadow block type only for clarity. 
Magnified image 320 includes enlarged (magnified) text 335 

(i.e., a portion of text "LINK 3" and all of text "LINK 4") 
that is read from a portion of the image data associated with 
a selected region 315 of original background image 310. Note 
that the image data associated with selected region 315 is 
magnified using known techniques such that magnified image 
320 covers the entire width of display 300, but only covers a 
fraction of the height of display 300 such that portions 310A 
and 31 0B of original background image 310 are shown above 
and/or below magnified image 320. Accordingly, the 
magnification tool allows a user to maintain the context of 
magnified image 320 relative to the position of the 
corresponding magnified text in original background image 
310 . 

[0018] According to another aspect of the present 

invention, cursor position data, which is typically utilized 

by a GUI to position cursor 330 on display 300, is also used 

to determine the position and content of magnified image 320. 
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Specifically, cursor 330 is positioned by a user via an input 

device (e.g., a mouse or trackball) to a desired cursor 

position 331. Cursor position data stored in the video 

memory of the Internet appliance indicates cursor position 

331 at a given time. According to the present invention, the 

cursor position data indicating cursor position 331 is 

utilized to position according to the formulations provided 

below such that a point on magnified image 32 0 coincides with 

a point on original background image 310, which in turn 

coincides with cursor position 331. By modifying magnified 

image 32 0 such that the points coincide with cursor position 

331, a user is able to utilize the magnification tool of the 

present invention to precisely position cursor 33 0 over 

selected regions of original background image 310 that they 

are enlarged (magnified) for easy identification. As a 

result, if selected region 315 includes interface elements 

such as hyperlinks, then those interface elements are visible 

to be selected (clicked upon) within magnified region 32 0. 

These features are explained further below. 

[0019] Figure 4 is an exploded diagram depicting the 

individual layers 300A, 300B, and 300C that are superimposed 

to form the composite image shown on display 300. Original 

background image layer 3 0 OA depicts original background image 

310, which is generated from image data stored in the display 

buffer of the video memory. As discussed above, original 

background image 310 includes unmagnified text 325 and 

selected region 315, which is determined by a point 311 that 

corresponds with cursor position 331 (shown in layer 300C) . 

The dashed line surrounding a portion of original background 

image 310 is shown for reference only, and is not visible on 

display 300 as shown. Overlay surface layer 300B includes 

magnified image 32 0, whose content and vertical position are 
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determined by a point 321, which corresponds with cursor 
position 331 (shown in layer 300C) . Specifically, the 
position of selected region 315 is determined using the 
formulas discussed below, and image data corresponding to the 
portion of original background image 310 surrounded by 
selected region 315 is magnified to form magnified image 320. 
The contents of overlay surface layer 3 0 OB are generated from 
a portion of the video memory other than the display buffer. 
Overlay surface layer 3 0 0B is superimposed onto original 
background image layer 3 0 OA such that portions of original 
background image 310 located "under" magnified image 320 are 
masked. Finally, cursor layer 3 0 0C, which includes cursor 
33 0 located at cursor position 331, is superimposed on top of 
magnified image 320. Display 300 therefore displays layers 
300A-300C, where points 311, 321, and cursor location 331 are 
co-located. 

[002 0] In one embodiment, magnified region 32 0 is defined 

as a block transfer (BLT) from the data displayed within 

selected region 315. Thus, selected region 315 is duplicated 

exactly into the overlay surface portion of the video memory, 

having the same shape and size. During display of the 

overlay surface, a transformation is performed to expand the 

duplicated portion of selected region 315 such that magnified 

region 320 is generated on display 300. One such 

transformation is described below with respect to Figure 5. 

As described above, magnified region 32 0 is positioned on top 

of original background image 310 in such a way that the point 

of magnified region 32 0 appearing under the cursor at cursor 

position 331 corresponds to the point of original background 

image 310 at cursor position 331. Although the magnified 

region overlay surface is visible on the display, it is the 

interface elements within the original background image 310 
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that respond to mouse clicks. Thus, original background 
image 310 and cursor 330 operate as if magnified region 320 
were not superimposed therebetween. Accordingly, the 
magnification tool of the present invention is easily 
incorporated into existing GUI's with minimal disruption in 
the operation of a host Internet appliance. 
[0021] In another embodiment, magnified region 320 is 

defined as an expanded transfer (called a stretch BLT) from 
the data displayed at selected region 315. Thus, selected 
region 315 is duplicated and transformed into the overlay 
surface portion of the video memory. The transformation is 
such that the rendering of magnified region 32 0 is stored in 
the video memory, making the region stored in the overlay 
surface portion of the video memory larger than that of 
selected region 315. During display, the overlay surface is 
displayed directly as magnified region 320 on display 300 
without further transformation. 

[0022] Figure 5 is a diagram of a display 500 according 

to an embodiment of the present invention. Display 500 
depicts an original background image 510. Display 500 has a 
coordinate reference system defining the origin at the upper 
left portion of the display such that the X axis extends 
along the top of display 500, increasing in value towards the 
right hand side of the display, and the Y axis extends along 
the left hand side of display 500, increasing in value 
towards the bottom of the display. Original background image 
510 contains unmagnified text 525. Magnified image 520 is 
displayed on top of original background image 510 and 
contains magnified text 535. 

[0023] Magnified image 520 extends the width of display 

500 to maximize readability of magnified text. Other 

embodiments extend magnified image 52 0 only to the edge of 
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the safe display region of a television set to further 
increase readability on some displays. A safe display region 
is that portion of a display that is guaranteed to be 
visible. Magnified image 520 contains the magnified contents 
of selected region 515. The size of selected region 515 is 
determined by both the relative position of cursor 53 0 to the 
edges of original background image 510 and the amount of 
magnification desired. 

[0024] Cursor 530 is positioned with an X axis value 

equal to X c and a Y axis value equal to Y c . That is, cursor 
53 0 points at the coordinate (X c , Y c ) . The position of cursor 
530 (X C/ Y c ) is a known value, e.g. cursor position 331 of 
Figure 4. Original background image 510 is positioned at the 
origin. That is, original background image 510 has a left- 
most upper point at (0, 0) . Original background image 510 
extends the width of display 50 0 to an X axis value of X B2 and 
the height of display 500 to a Y axis value of Y B2 - Thus, the 
width of original background image 510 is equal to X B2/ and 
the height of original background image 510 is equal to Y B2 . 
The width X B2 and height Y B2 of original background image 510 
are known values. 

[0025] As shown in Figure 5, selected region 515 extends 

from (X A1 , Y A1 ) to (X A2 , Y A2 ) - Thus, the width of selected 
region 515 is equal to X A2 - X Ai , or A X3 , and the height of 
selected region 515 is equal to Y A2 - Y Ai , or A Y3 - Similarly, 
magnified image 52 0 extends from (X M1 , Y M i) to (X M2/ Y M2 ) . In 
one embodiment, X M i and X M2 , are located at the edges of 
display 500, 0 and X B2 , respectively. The width of magnified 
image 52 0 is equal to X M2 - X M i, or A x2 , and the height of 
magnified image 520 is equal to Y M2 - Y M i, or A Y2 . The width 
A x2 and height A Y2 of magnified image 520 are known values. 
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The magnification level is the amount of increase in size of 
the contents of selected region 515 and is also a known 
value, determined prior to display of magnified image 520. 
Thus, the width A X2 of magnified region 52 0 is equal to the 
magnification level multiplied the width A X3 of selected 
region 515 and the height A Y2 of magnified region 520 is equal 
to the magnification level multiplied the height A Y 3 of 
selected region 515. Therefore, the height and width, A x3 and 
A Y 3, respectively, of selected region 515 are known. 

[0026] With respect to the display coordinate system, 

magnified image 52 0 is positioned with an X axis value equal 
to the left-most edge of original background image 510, or X M i 
= X B i- As previously mentioned, the height of overlay surface 
520 is equal to A Y2 . The height of magnified image 520 is 
centered around cursor position 531 of cursor 530. 
Therefore, magnified image 52 0 has a upper left corner Y axis 
value Ymi equal to the Y axis value of the cursor less half 
the height of magnified image 520, or Y c - 0.5 * A Y2 . As a 
result, magnified image 52 0 has a left -most upper point at 

(X M i, Y m1 ) = (X B i, Y c -0.5*A Y2 ). 

[0027] To determine the X axis location (X A i) of selected 

region 515, the relative position of the cursor (X c ) with 
respect to the X axis value of the left-most portion of 
selected region 515 (X A i) is determined. In other words, the 
X axis value of the left-most portion of selected region 515, 
Xai, is equal to the X axis value of cursor 530 (X c ) less the 
distance between the X axis value of the cursor (X c ) and the 
left-most portion of selected region 515 (X A i) , or A X 4 - 
Therefore : 
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X A1 = X c - A X4 Equat ion 1 . 

[0028] The relative position of cursor 530 to the 

contents of selected region 515 is equal to the relative 
position of cursor 530 to the contents of magnified image 520. 
Thus, the relative position of cursor 530 with respect to the 
X axis value of the left-most portion of selected region 515 
(Ax4) to the width of selected region 515 (A X 3) is equal to the 
relative position of cursor 530 with respect to the X axis 
value of the left-most portion of magnified region 520 (A X i) 
to the width of magnified region 520 (A X 2) • In other words: 



A YA A jr, 

— = — Equation 2 

A XZ A X2 



Solving for A 



•X4 • 



A XA =^-A X3> Equation 3 

A X2 



[0029] Because A X i is equal to the relative position of 

the cursor (X c ) with respect to the X axis value of the left- 
most portion of magnified region 520 (X M i) / or A xi = X c - X M i, 
Equation 3 becomes: 



A X4 = ( X c X mi) A xi Equation 4 

A X2 



As a result, combining Equation 1 with Equation 4 results in 
the X axis value of the left-most portion of selected region 
515 as: 
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X A1 =X C - ( * C X ^ )A ™ Equation 5. 

A X2 



[0030] To determine the Y axis location (Y A1 ) of selected 

region 515, the relative position of cursor 53 0 (X c ) with 
respect to the Y axis value of the upper-most portion of 
selected region 515 (Y A1 ) is determined. In other words, the 

Y axis value of the upper-most portion of selected region 515, 
Y A i, is equal to the Y axis value of cursor 53 0 (Y c ) less the 
distance between the Y axis value of the cursor (Y c ) and the 
upper most-portion of selected region 515 (Y Ai ) , or A Y 4. 
Therefore : 

Y A1 =Y C -A y4 Equation 6. 

[0031] The relative position of cursor 530 to the 

contents of selected region 515 is equal to the relative 
position of cursor 530 to the contents of magnified image 520. 
Thus, the relative position of cursor 53 0 with respect to the 

Y axis value of the upper-most portion of selected region 515 
(A Y4 ) to the height of selected region 515 (A Y3 ) is equal to 
the relative position of cursor 530 with respect to the Y axis 
value of the upper-most portion of magnified region 520 (A Y1 ) 
to the height of magnified region 520 (A Y2 ) . In other words: 



A™ A yi 

— £^- = — ii- Equation 7, 

^Y3 ^Y2 



Solving for A Y4 : 
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A Y4 =^-A Y3 Equation 8. 

[0032] Because A Y i is equal to the relative position of 

the cursor (Y c ) with respect to the Y axis value of the upper- 
most portion of selected region 515 (Y B i) , Equation 3 becomes: 

A Y4 = (Yc ~ Ym)Ar3 Equation 9. 

As a result, combining Equation 6 with Equation 9 results in 
the Y axis value of the bottom-most portion of selected 
region 515 as: 

(Y -F )A 

Y A1 =Y C --^ mJ Y3 Equation 10. 

Therefore, selected region 515 has a left-most upper-most 

^ ■ . . , v v \ / V (X c -X M1 )A X3 (Y c - Y m )A Y3 

point at (X Ai/ Y A1 ) = ( A c , Y c 

& X2 A 72 

[0033] Figures 6(A) through 6(D) are simplified display 

screens showing the relationship between movements of a 
cursor 63 0 on a display 600 and those of magnified region 62 0 
according to the equations described above. As indicated in 
Figure 6(A), when cursor 630 is located in the center of 
display 600, points 611 and 621 and cursor position 631 

(which respectively correspond to points 311, 321 and cursor 

position 331 of the embodiment shown in Figure 4) are also 

located in the center of selected region 615. Accordingly, 

both selected region 615 and magnified image 62 0 are centered 

on display 600. As shown in Figure 6(B), when cursor 630 is 

moved up from this centered position, magnified region 620 
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also moves up, thereby magnifying a different portion of the 
original background image. Note that the upward movement of 
cursor 630 causes cursor position 631 and points 611 and 621 
to move upward within selected region 615. Referring to 
Figure 6(C), moving cursor 630 horizontally to the left from 
the position shown in Figure 6 (B) causes selected region 615 
to move left, thereby changing the content of magnified image 
620. However, because there is no vertical component to the 
position change of cursor 63 0, the position of magnified 
region 620 remains in the same relative to display 600. Note 
again that the leftward movement of cursor 63 0 causes cursor 
position 631 and points 611 and 621 to move leftward within 
selected region 615. Finally, moving cursor 620 to the lower 
right from the position of Figure 6 (C) results in the 
magnified region 62 0 moving to the lower right portion of 
display 600 and magnifying a portion of display 600 down and 
to the right of that portion displayed in Figure 6(C) . Again 
note that cursor position 631 and points 611 and 621 have 
moved to the lower right corner of selected region 615 in 
response to this cursor movement. 

[0034] Although the present invention has been described 

with respect to certain specific embodiments, it will be 
clear to those skilled in the art that the inventive features 
of the present invention are applicable to other embodiments 
as well, all of which are intended to fall within the scope 
of the present invention. For example, in one embodiment, 
the unmagnified text obscured by the magnified region may be 
displayed in some fashion (e.g. alpha blending) through the 
magnified region to further enhance context. 
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